BRFP: An Efficient and Universal Sentence Embedding Learning Model Method Supporting Fused Syntax Combined with Graph Embedding Representation Algorithm
نویسندگان
چکیده
Due to the rapidly growing volume of data on Internet, methods efficiently and accurately processing massive text information have been focus research. In natural language theory, sentence embedding representation is an important method. This paper proposes a new learning model called BRFP (Factorization Process with Bidirectional Restraints) that fuses syntactic information, uses matrix decomposition learn calculates word vectors obtain embedded sentences. experimental chapter, similarity experiments are conducted verify rationality effectiveness analyzed results Chinese English texts current mainstream methods, potential improvement directions summarized. The datasets, including STS, AFQMC, LCQMC, show proposed in this outperforms CNN method terms accuracy F1 value by 7.6% 4.8. comparison experiment vector weighted shows when length longer, or corresponding structure complex, model’s advantages more prominent than TF-IDF SIF methods. Compared method, effect improved 14.4%. it has maximum advantage 7.9%, overall each comparative task between 4 6 percentage points. neural network experiment, compared CNN, RNN, LSTM, ST, QT, InferSent models, significantly 14’OnWN, 14’Tweet-news, 15’Ans.-forum datasets. For example, 14’OnWN dataset, 10.9% over ST 14’Tweet-news dataset 22.9% LSTM 24.07% RNN article also demonstrates generality model, proving universal framework.
منابع مشابه
Learning Graph Representations with Embedding Propagation
Label Representations • Let l ∈ Rd be the representation of label l, and f be a differentiable embedding function • For labels of label type i, we apply a learnable embedding function l = fi(l) • hi(v) is the embedding of label type i for vertex v: hi(v) = gi ({l | l ∈ labels of type i associated with vertex v}) • h̃i(v) is the reconstruction of the embedding of label type i for vertex v: h̃i(v) ...
متن کاملActive Learning for Graph Embedding
Graph embedding provides an ecient solution for graph analysis by converting the graph into a low-dimensional space which preserves the structure information. In contrast to the graph structure data, the i.i.d. node embeddings can be processed eciently in terms of both time and space. Current semi-supervised graph embedding algorithms assume the labelled nodes are given, which may not be alwa...
متن کاملGraph Embedding with Constraints
Recently graph based dimensionality reduction has received a lot of interests in many fields of information processing. Central to it is a graph structure which models the geometrical and discriminant structure of the data manifold. When label information is available, it is usually incorporated into the graph structure by modifying the weights between data points. In this paper, we propose a n...
متن کاملGraph Embedding
Some of the parameters used to analyze the efficiency of an embedding are dilation, expansion, edge congestion and wirelength. If e = (u, v) ∈E (G), then the length of Pf (e) in H is called the dilation of the edge e. The maximal dilation over all edges of G is called the dilation of the embedding f. The dilation of embedding G into H is the minimum dilation taken over all embeddings f of G int...
متن کاملAn improved and efficient stenographic scheme based on matrix embedding using BCH syndrome coding.
This paper presents a new stenographic scheme based on matrix embedding using BCH syndrome coding. The proposed method embeds massage into cover by changing some coefficients of cover. In this paper defining a number :::as char:::acteristic of the syndrome, which is invariant with respect to the cyclic shift, we propose a new embedding algorithm base on BCH syndrome coding, without finding ro...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Sensors
سال: 2022
ISSN: ['1687-725X', '1687-7268']
DOI: https://doi.org/10.1155/2022/7471408